This GitHub repository contains a course on Large Language Models (LLMs) with roadmaps and Colab notebooks. The course is divided into three parts: LLM Fundamentals, The LLM Scientist, and The LLM Engineer. Each part covers various topics, including mathematics, Python, neural networks, instruction datasets, pre-training, supervised fine-tuning, reinforcement learning from human feedback, evaluation, quantization, new trends, running LLMs, building a vector storage, retrieval augmented generation, advanced RAG, inference optimization, and deployment.
A powerful library by Amazon — coding example included
Github Copilot
